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A search has been performed for B^ — !> pi^/i^ and B" -^ /i^M^ decays using 7fb^^ of integrated 
luminosity collected by the CDF II detector at the Fermilab Tevatron collider. The observed number 
of B" candidates is consistent with background-only expectations and yields an upper limit on 
the branching fraction of B{B^^ — >■ fi'^n~) < 6.0 x 10~^ at 95% confidence level. We observe 
an excess of _B^ candidates. The probability that the background processes alone could produce 
such an excess or larger is 0.27%. The probability that the combination of background and the 
expected standard model rate of B^ — i- fJ,'^ fi^ could produce such an excess or larger is 1.9%. These 
data are used to determine B{B^ — >■ /i^fi") = (LSlgg) x 10~* and provide an upper limit of 
B(B° -> ^l^^J.~) < 4.0 X 10~* at 95% confidence level. 
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Studies of flavor-changing neutral current (FCNC) de- 
cays have played an important role in formulating the 
theoretical description of particle physics known as the 
standard model (SM) . In the SM all neutral currents con- 
serve flavor so that FCNC decays do not occur at lowest 
order. The decays of S^ mesons (with a quark content 
of 5s) and B''* mesons {bd) into a dimuon pair {fi^fi~) [l| 
are examples of FCNC processes that can occur in the 
SM through higher order loop diagrams. Their branching 
fractions are predicted in the SM to be (3.2 ±0.2) x 10~^ 
and (1.0 ± 0.1) x 10~^°, respectively ^. A wide vari- 
ety of beyond- SM theories predict significant increases 
over the SM branching fraction [3| , making the study of 
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B'^ -^ l-i^ ji^ and B^ -^ M^M^ decays one of the most sen- 
sitive indirect searches for new physics. Pubhshed upper 
hmits y-lsf contribute significantly to our knowledge of 
the available new physics parameter space |7H11 1 . 
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We report a search for S" -^ 1^^ IJ-~ and S" 
decays using pp data corresponding to an integrated lu- 
minosity of 7 fb~ collected with the Collider Detector 
at Fermilab (CDF II). The sensitivity of this analysis is 
significantly improved with respect to the previous anal- 
ysis y due to the higher integrated luminosity of the 
event sample, a 20% increase in the signal acceptance, 
and the use of an improved neural-network (NN) discrim- 
inant that provides approximately twice the background 
rejection for the same signal efficiency. 

A detailed description of the CDF II detector can be 
found in Ref. [l^. A charged particle tracking system 



provides precise vertex determination and momentum 
measurements in a pseudorapidity range |?7| < 1.0. Ad- 
ditionally, the system measures the ionization per unit 
path length dE/dx for particle identification. Beyond 
the tracking detectors are electromagnetic and hadronic 
calorimeters, which are surrounded by drift chambers 
used to detect muons in the central region (C) |r/| < 0.6 
and the forward region (F) 0.6 < |ry| < 1.0. 

The online (trigger) requirements used to collect the 
data sample and the initial set of baseline requirements 
used in the analysis are the same as those described in 
Ref. |13| . The events are collected using a set of dimuon 
triggers [1^ and must satisfy either of two sets of require- 
ments corresponding to different topologies: CC events 
have both muon candidates detected in the central re- 
gion, while CF events have one central muon and an- 
other muon detected in the forward region. Since the 
expected signal-to-background ratios are different, the 
two topologies are treated separately. The acceptance 
of the analysis is improved by 20% by using additional 
toward muon candidates and by using muon candidates 
that traverse detector regions previously excluded due to 
their rapidly changing trigger efficiency. The larger data 
sample has allowed us to obtain a detailed understand- 
ing of the trigger performance in these regions so that we 
can confidently include these muon candidates in the cur- 
rent analysis. The baseline selection requires high quality 
muon candidates with transverse momentum relative to 
the beam direction oi pT > 2.0 (2.2) GcV/c in the central 
(forward) region. The muon pairs are required to have an 
invariant mass in the range 4.669 < m^^ < 5.969 GeV/c^ 
and are constrained to originate from a common well 
measured three-dimensional (3D) vertex. A likelihood 



method [ij] together with a dE/dx based selection [15 1 
are used to further suppress contributions from hadrons 
misidentified as muons. The baseline requirements also 
demand that the measured proper decay length of the B 
candidate A with its uncertainty ax satisfy A/cta > 2; the 
3D opening angle between the momentum of the dimuon 
pair and the displacement vector between the primary 
pp collision vertex and the dimuon vertex Ail < 0.7 rad; 



and the i?-candidate track isolation [l6[ / > 0.50. There 
are 48 279 CC and 52 179 CF muon pairs that fulfiU the 
trigger and baseline selection requirements. 

A sample of B~^ — s- J/tp K^ events serves as a nor- 
malization mode. The B^ -^ J /ijj K^ sample is col- 
lected using the same dimuon triggers and selection re- 
quirements so that common systematic uncertainties are 
suppressed. An additional requirement on the kaon can- 
didate pt > 1 GeV/c is made to limit the pt range to a 
region where the tracking efficiency is well understood. 

For the final selection, we define search regions around 
the known i?° and 5° masses [17|. These regions corre- 
spond to approximately ±2.5crm, where am ~ 24 MeV/c^ 
is the estimated two-track mass resolution. The sideband 
regions 5.0 < m^^ < 5.169 GeV/c^ and 5.469 < to^^ < 
5.969 GeV/c^ are used to estimate combinatorial back- 
grounds. Backgrounds from B -^ h^h'^ decays (where 
h, h' = TT^ or K ), which peak in the signal mass region, 
are estimated separately. 

Fourteen variables are used to construct a NN discrim- 
inant i/N that ranges from to 1 and enhances the signal- 
to-background ratio [l8|. The variables include dimuon 
vertex related information (e.g. A/cta), the impact pa- 
rameters with respect to the primary vertex and trans- 
verse momenta of the muons, the isolation of the B candi- 
date, and the opening angle ASl. The NN is trained with 
background events sampled from the sideband regions 
and signal events generated with a simulation described 
below. Only a fraction of the total number of background 
and simulated signal events are used to train the NN. The 
remainder are used to test for NN overtraining and to de- 
termine the signal and background efficiencies. Several 
tests are done to ensure i/jv is independent of ?7i^^ . 

All selection criteria were finalized before revealing 
the content of the signal regions. The optimization 
of the criteria used the expected upper limit on the 
_Bg — >■ z^"*"^" branching fraction as a figure of merit. 
To exploit the difference in the m.^^ distributions be- 
tween signal and background and the improved sup- 
pression of combinatorial background at large vn, the 
data is divided into sub-samples in the (j^at,?/!^^) plane. 
The CC and CF samples are each divided into 40 sub- 
samples. There are eight bins in ly^ with bin bound- 
aries 0.70,0.76,0.85,0.90,0.94,0.97,0.987,0.995 and 1. 
Within each j/jv bin we employ five m^^ bins, each 
24 MeV/c^ wide, centered on the world average B'^{B'^) 
mass. The expected backgrounds and efficiencies are cal- 
culated in each bin separately. 

For measuring efficiencies, estimating backgrounds, 
and optimizing the analysis, samples of i?g (5°) — >■ fJ,~^fJ,~ , 
B^ — !■ J/ip A'+, and B -^ h'^h'~ are generated with the 
PYTHIA program [l9| and a CDF II detector simulation. 
The Pt spectrum and the / distribution of the S-mesons 
are weighted to match distributions measured in samples 
of B+ -^ J/iIj K+ and 5° -^ Jji) cj) events [H. 

We use a relative normalization to determine the S!? — ;• 



fj-'^ ^-i branching fraction: 



N, a. 



^N Is 



where A*"., is the number of B'^ — > /i^/U candidate events. 
The observed number of B^ -^ J/ij] K^ candidates 
is N+ = 22 388 ± 196 and 9 943 ± 138 in the CC and 
CF channels, respectively. The contribution of B^ -^ 
J/ip 7r+ events is negligible. We use B{B^) = B{B~^ -^ 
J/i} K+ -^ fi+n-K+) = (6.01 ± 0.21) X 10-5 [i3 
and the ratio of i3- meson production fractions f+/fs = 
3.55 ± 0.47 [17[. The parameter Us («+) is the accep- 
tance of the trigger and Eg (e+) is the efficiency of the 
reconstruction requirements for the signal (normaliza- 
tion) mode. The reconstruction efficiency includes trig- 
ger, track, muon, and baseline requirement efficiencies. 
The NN efficiency en only applies to the signal mode 
since it is not used to select the B+ -^ J/ip A'+ sample. 
The expression for B{B^ — >• /x"*"^^) is derived by replac- 
ing B° with B° and U/f, with f+ffd = 1. The ratios 
of acceptances a+ /as are 0.307±0.018 and 0.197±0.014 
for the CC and CF topologies, respectively. These ratios 
are measured using simulated events. The uncertainties 
include contributions from systematic variations of the 
modeling of the i?-meson pT distributions and the lon- 
gitudinal beam proffie. The ratio of reconstruction effi- 
ciencies is e+/es = 0.81 ± 0.03 as determined from stud- 
ies using samples of J/^p -^ 1^'^ ^J'~ and i?+ — > J/ip K^ 
events collected with the same triggers. The uncertainty 
in e+/es is dominated by kinematic differences between 
J/V' -^ M^A*~ and B^{B°) — >■ iJ,'^fJ,~ decays. The €n is 
estimated from the simulation. We assign a relative sys- 
tematic uncertainty on eAr of 4-7% , depending on i/^v bin, 
using comparisons of the NN performance in simulated 
and observed i?+ — > J/^p /v+ event samples, and the 
statistical uncertainty on studies of the pt and / distri- 
butions from observed B*^ — >• J/ijj (p event samples. The 
B^ — > fJ.^ji'^ decay is determined to have the same ac- 
ceptances and efficiencies. Treating CC and CF together, 
about 90% of simulated i3° — )• fi^^J,~ events surviving the 
initial requirements have v^ > 0.70, with about 45% hav- 
ing VN > 0.995. The expected SM yield of B° -^ ii+^j.- 
events ranges from 0.05 in the lowest vn bin to 1.0 events 
in the highest v^ bin summing the CC and CF contri- 
butions. The expected SM yield of B^ -^ M^A*^ events 
is about thirty times smaller. 

The expected background is obtained by summing con- 
tributions from the combinatorial background and from 
B — !■ h^h'^ decays. To estimate the combinatorial back- 
ground, we fit the m^^ distribution of sideband events 
with :^jv > 0.70 to a linear function. We only use events 
with 77ipp> 5 GeV/c^ in order to suppress contributions 
from b — ?► jjL^ ^~ X decays. The slopes are then fixed, 
and the normalization is determined for each j/^r bin sep- 
arately using the relevant sideband events. In addition 
to the statistical uncertainties of the slope and normal- 



ization parameters, systematic uncertainties are assigned 
by comparing results derived using alternative fit func- 
tions and ranges. The systematic uncertainties vary from 
about 7% for the lower vm bins to about 45% for the high- 
est Vf4 bins. The B -^ h^h'~ contributions are estimated 
using efficiencies deterinined from the simulation, prob- 
abilities of misidentifying hadrons as muons measured in 
data, and normalizations derived from their branching 



fractions [15|, [17[. The hadron misidentification prob- 
abilities are parameterized as a function of hadron pT 
and instantaneous luminosity using a D^ -^ K^ir^ data 
sample obtained from Z?*+ -^ D°7r+ decays. In addition 
to the statistical uncertainties from the I?° sample, sys- 
tematic uncertainties are assigned to account for resid- 
ual variations of the misidentification probability due 
to variations in detector performance (primarily arising 
from occupancy and calibration effects) and for branch- 
ing fraction uncertainties. For the B^ modes there is 
an additional uncertainty from /+//s. The estimated 
B — > h^h'~ background is approximately one quarter of 
the total background in the i?° —J- n~^ii~ search while 
in the B^ -^ /^^A*^ search it is a factor of ten smaller 
than both the combinatorial background and the SM sig- 
nal. The expected background is shown in Fig. [1] for the 
B^ -^ fj-^l-i.^ and B^ -^ M^A^^ searches. The background 
estimates are cross-checked using three sets of indepen- 
dent control samples: /i^/i" events with A < and /^^/i^ 
events, both of which are dominated by combinatorial 
backgrounds, and a misidentified-muon enhanced ^i^ pT 
sample with at least one muon candidate failing the muon 
quality requirements. The latter sample has a significant 
contribution from B — )■ h'^h'~ backgrounds. We compare 
the predicted and observed number of events in each of 
these control samples for all 80 sub-samples and observe 
no significant discrepancies. 

Two fits are performed on the data, a background- 
only fit (6) and a signal-plus-background fit (s -|- b) for 
which the branching fraction of the signal is left float- 
ing. A log-likelihood ratio is formed, — 21nQ, where 
Q = C{s + 6|data)/£(6|data) and C{h\x) is the likeli- 
hood of hypothesis h given observation x; this likelihood 
is obtained by multiplying Poisson probabilities over all 
80 sub-samples and is minimized with respect to the 
nuisance parameters that model our systematic uncer- 
tainties. To evaluate the consistency of the data in the 
signal region with our background model, we compare 
the observed value of — 21nQ with the distribution of 
—2lnQ obtained from an ensemble of background-only 
simulated experiments. The effects of systematic un- 
certainties are included in the simulated experiments by 
randomly choosing the nuisance parameters from Gaus- 
sian distributions. The fraction of simulated experiments 
with a value of —2 In Q less than that observed in the data 
is used to determine the p- value for the background-only 
hypothesis. 

The data in the signal regions are shown in Fig. [T] us- 
ing the (I'N, ''^^■^l^l) binning from the optimization. In the 
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FIG. 1: For the B'^ and B" signal regions, the observed number of events (points) is compared to the total expected background 
(light grey) and its uncertainty (hatched) using the (i^Ar,m;j^) bins from the optimization. The background uncertainty is the 
quadrature sum of the relevant systematic uncertainties. The top and middle rows show the results in the Bg mass signal 
region for the CC and CF channels, respectively. The bottom row shows the results in the B" mass signal region for the CC 
and CF channels combined. The results for the first 5 vn bins are combined (and scaled by 0.2) while the results for the last 
three bins are each shown separately. Also shown is the expected contribution from B^ — >■ fJ,^ jJ.^ events (dark gray) using a 
branching fraction that corresponds to the central value from the fit to the data, which is 5.6 times the expected SM value. 



B" search region the data are consistent with the back- 
ground prediction and have a p- value of 23%. In the S^ 
search region the data exceed the background prediction 
and have a p- value of 0.27%. The excess is concentrated 
in bins with i^jy > 0.97. If we restrict ourselves to only 
the two highest i^jv bins {i^n > 0.987), which together 
account for 85% of the signal acceptance, we find a p- 
value of 0.66%. For the B^ — >■ fj.~^fj,~ analysis we also 
produce an ensemble of simulated experiments that in- 
cludes a B^ -^ A'^M~ contribution at the expected SM 
branching fraction [2| and yields a p- value of 1.9%. The 
corresponding p- value for the two highest i/at bins alone 
is 4.3%. 



We use a modified frcqucntist approach [20|, |2lJ that 
includes the effects of systematic uncertainties to cal- 
culate expected and observed limits. We calculate ex- 
pected limits of B{B" -^ fJ-'^fJ-') < 4.6 x 10"^ and 



6(5° 



-> 



fi+fi- 



< 1.5 X 10~* at the 95% confidence 



level (C.L.), a factor 3.3 improvement relative to our 
previous analysis [J]. We calculate observed limits of 
B{B° ^ /i+Ai") < 6.0(5.0) X 10-9 and B(B° -^ n+^j.-) < 
4.0(3.5) X 10-^ at 95% (90%) C.L. If we assume the ob- 
served excess in the B^ region is due to signal, we de- 
termine i3(_B° -^ ^+/x-) = (1.8+J;g) X 10"^ using the data 
— 2 In Q distribution and taking the central value from the 
minimum and the associated uncertainty as the interval 
corresponding to a change of one unit. By examining the 



interval corresponding to a change of 2.71 units we set 
bounds of 4.6 X lO'^ < B(B° -^ n+fi-) < 3.9 x 10"^ at 
the 90% C.L. As a cross check we use a Bayesian tech- 
nique to make a point estimate and to derive bounds 
at 90% C.L. and obtain results very similar to those 
reported here. Using the central value for the fitted 
Bg -^ /^^M~ branching fraction we produce an ensem- 
ble of simulated experiments and find a p- value of 50%. 



The source of the data excess in the 0.970 < i^at < 
0.987 bin of the 5° signal region is investigated. The 
same events, same fits, and same methodologies are used 
for both the B^ and _B" searches. Because the data in 
the B" search region shows no excess, problems with 
the background estimates are ruled out. In particular, 
the only peaking background in this mass region is from 
B — > h^h'~ decays, whose contribution to the S" search 
region is ten times larger than to the B'^ search region. 
Problems with the NN are ruled out by the many stud- 
ies performed. These NN studies find no evidence of a 
i^N- iTT'p.p, correlation, no evidence of overtraining, and no 
evidence of a significant mis-modeling of the z/^v shape, 
even in the region 0.995 < vn- In short, there is no evi- 
dence that the excess in this bin is caused by a mistake 
or systematic error in our background estimates or our 
modeling of the vn performance and distribution. The 
most plausible remaining explanation is that this is a sta- 
tistical fluctuation. For our central result we use the full 



set of bins that had been established a priori since this 
represents an unbiased choice. As discussed above, if we 
remove the 0.970 < i^n < 0.987 bin the results are not 
significantly affected. 

In summary, wc have performed a search for B^ — >■ 
/i+/z~ and i3° — >■ iJ,^fJ.~ decays using 7 fb~^ of integrated 
luminosity collected by the CDF II detector at the Fer- 
milab Tevatron. The data in the i?° search region are 
consistent with background expectations and the world's 
most stringent upper limit on B{B'^ -^ ^'^ jjl^) is estab- 
lished. The data in the B^ search region are in excess of 
the background predictions with a p- value of 0.27%. A fit 
to the data determines 6(B° -> //+M")= (l-Stag) x 10"*^ 
including all uncertainties. 
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